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ABSTRACT 

By emp loying a concomitant variable, block designs 
and analysis of covariance (ANCOVA) can be used to improve the power 
of traditional analysis of variance (ANOVA) by reducing error. If 
subjects are randomly assigned to treatments without considering the 
concomitant variable, an experiment uses a post-hoc approach. 
Otherwise, an a priori approach is used if the concomitant variable 
is utilized for assigning subjects to treatments. Traditionally, a 
priori has been considered the more powerful approach. This study 
compared ANOVA, block designs, and ANCOVA under various experimental 
conditions. The experimental conditions were 48 combinations of 4 
levels of the number of treatments (T at 2, 3, 4, and 5) , 3 levels of 
the number of subjects per treatment (n at 8, 40, and 72), and 4 
levels of the correlation coefficient between the concomitant and 
dependent variables (p at 0.00, 0.28, 0.56, and 0.84). The optimal 
number of blocks to achieve maximum power was also investigated. 
Results indicated that a priori was not generally more powerful than 
post-hoc. Fo^ ANOVA, a priori became less powerful as T and p 
increased. For block designs, the preference depended on the 
experimental conditions. For ANCOVA, a priori was more powerful when 
T and n were small, appendix A explores apparent imprecision. 
Appendix B presents two Statistical Analysis System computer 
programs, and Appendix C contains a power table. (Contains 9 tables 
and 3 references.) (Author/SLD) 
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Discussion (research) 192 

"A PRIORI VERSUS POST-HOC: COMPARING 
STATISTICAL POWER AMONG ANOVA, BLOCK DESIGNS, 
AND ANCOVA" 

By employing a concomitant variable, block designs and 
ANCOVA can be used to improve the power of traditional ANOVA by 
reducing error. If subjects are randomly assigned to treatments 
without considering the concomitant variable, an experiment uses 
a post-hoc approach. Otherwise, an a priori approach is used if 
the concomitant variable is utilized for assigning subjects to 
treatments. Traditionally, a priori has been considered the more 
powerful approach. The purpose of this study is to compare 
statistical power of a priori and post-hoc approaches among 
ANOVA, block designs, and ANCOVA under various experimental 
conditions. The experimental conditions were 48 combinations of 
four levels of the number of treatments (T; 2, 3, 4, 5), three 
levels of the number of subjects per treatment (n; 8, 40, 72) , 
and four levels of the correlation coefficient between the 
concomitant and dependent variables (p; .00, .28, .56, .84). The 
optimal number of blocks to achieve maximum' power was also 
investigated. 

Results indicated that a priori was not generally more 
powerful than post-hoc. For ANOVA, a priori became less powerful 
as T and p increased. For block designs, the preference depended 
on the experimental conditions. For ANCOVA, a priori was more 
powerful when T and n were small. 
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A PRIORI VERSUS POST-HOC: COMPARING STATISTICAL POWER AMONG 
ANOVA, BLOCK DESIGNS. AND ANCOVA 

The most widely used procedures to harness the positive effects of a concomitant variable are block 
designs and ANCOVA. Whether to block or covary and how many blocks to xxse if a block design is chosen 
become crucial decisions. Wu and McLean (1993, November) and Wu (1994) provided an historical review of 
the problem, finding that some researchers favor block designs while others prefer ANCOVA. The most 
comprehensive studies on this topic were conducted by Feldt (1958) and Maxwell and Delaney (1984). Feldt 
analytically examined the problem using Apparent Imprecision as the criterion variable, while Maxwell and 
Delaney empirically examined the problem using the Type I error rate and power in addition to Apparent 
Imprecision as the criterion variables. Based on Apparent Imprecision, Feldt found the correlation coefficient 
between the concomitant and dependent variables is the factor in choosing blocking or ANCOVA. He also 
provided the optimal number of blocks to use if blocking is chosen. Feldt' s findings have been cited by many 
research articles and texts discussing this work (cf.. Maxwell & Delaney, 1984; Wu, 1994; Wu & McLean, 
1993, November, 1994b). 

The recommendation to consider the correlation in choosing blocking or ANCOVA is rejected by 
Maxwell and Delaney (1984); "instead, the two factors that should be considered are whether scores on the 
concomitant variable are available for ail subjects prior to assigning any subjects to treatment conditions and 
whether the relationship of the dependent and concomitant variable is linear" (p. 136). Since Maxwell and 
Delaney suggested that power might provide a different perspective from Apparent Imprecision, the number of 
blocks used by them, which was based on Apparent Imprecision and recommendations by Keppei (1973) and 
Winer (1971), may not result tn the optimal number of blocks to achieve maximum power. This potential 
limitation is magnified by the restricted experiment conditions used by them. 

Wu and McLean (1994b) examined the blocking versus ANCOVA issue and estimated the optimal 
number of blocks to achieve maximum power using broader and more representative experimental conditions. 
They recommended that, when deciding among a completely randomized ANOVA, a block design, or 
ANCOVA, researchers should consider the assumptions of the procedures and weigh the magnitude of the 



•i 



A Priori Versus Post-Hoc 
2 

power increase against the added cost of blocking or covarying. The Wu and McLean study described how 
Apparent Imprecision is similar to and different from statistical power, and why the correlation between the 
concomitant and dependent variables is considered the critical factor in choosing blocking or ANCOVA based 
on Apparent Imprecision. They also pointed out the potential problems with Apparent Imprecision and 
recommended power be used in preference to Apparent Imprecision. A comparison of power and Apparent 
Imprecision and a critique of Apparent Imprecision are provided in Appendix A. Generally, the Wu and 
McLean study supported the recommendation by Maxwell and Delaney (1984) to use ANCOVA in preference to 
blocking if the assumptions for ANCOVA can be met. Nevertheless, results of the Wu and McLean-^study 
concluded that ANCOVA is not always more powerful than blocking, as suggested by Maxwell and Delaney. 
The Wu and McLean study was limited to using only the post-hoc approach. 

The Maxwell and Delaney study (1984) explored another dimension to the blocking versus ANCOVA 
issue by using the concomitant variable to assign subjects to treatments. If the concomitant variable is not 
considered when subjects are assigned to treatments, the experiment uses a post-hoc approach (Bonett, 1982; 
Keppel, 1973; Myers, 1979); otherwise an a priori approach is used. Maxwell and Delaney (1984) found that 
ANCOVA tends to be more powerful than blocking if the same approach is selected, and a priori tends to be 
more powerftil than post-hoc if the same procedure is selected. The purpose of the present study is to compare 
the statistical powers of a priori and post-hoc approaches among ANOVA, block designs, and ANCOVA using 
broad, . representative experimental conditions and varying the numbers of blocks based on statistical power. 

Procedures 

Experimental Conditions 

This Monte Carlo study compares the statistical powers among ANOVA, block designs, and ANCOVA 
under 48 experimental conditions with both post-hoc and a priori approaches. The 48 experimental conditions 
are combinations of four levels of the number of treatments (T; 2, 3, 4, 5), three levels of the number of 
subjects per treatment (n; 8, 40, 72), and four levels of the correlation coefficient between the concomitant and 
dependent variables (p; .00, .28, .56, .84). The levels of experimental conditions were selected to achieve 
equal intervals and to be representative of real world situations. The four levels of the number of treatments 
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represent the most commonly used numbers of treatments; the three levels of the number of subjects per 
treatment represent small, medium, and large sample sizes; and the four levels of the correlation coefficient 
represent zero, low, moderate, and high correlation. 
Method of Assignment 

For the a priori approach, the required total number of subjects were randomly selected and ranked by 
the concomitant variables. The highest ranked k subjects formed the first block; the second highest ranked k 
subjects formed the second block; and so on until the lowest ranked k subjects formed the nth block, where k is 
the number of treatments and n is the number of subjects per treatment. The subjects in each block then were 
randomly assigned to treatments. This method was chosen because of its simplicity and its ability to form the 
most homogeneous blocks. With this method of assignment, the concomitant variable should be classified as 
continuous according to Maxwell and Delaney (1984). For the post-hoc approach, subjects were randomly 
assigned to treatments without considering the concomitant variable. 
Method of Analysis 

For ANOVA, the concomitant variable was not considered in the analysis. For block designs, subjects 
in each treatment were blocked by their ranks on the concomitant variable. The block analyses included all 
possible numbers of blocks to achieve equal numbers of subjects in each block. For example, with 72 subjects 
per treatment, analyses were conducted with 2, 3, 4, 6, 8, 9, 12, 18, 24, 36, and 72 blocks. For ANCOVA, 
the concomitant variable was treated as the covariate in the analysis. 
Post-hoc ANOVA (Completely Randomized ANOVA) as the Control Group 

The experiment controlled the power of the post-hoc ANOVA (completely randomized ANOVA) at .50 
using the effect sizes reported by Wu (1994). This allows the power of the other proced'ires to increase or 
decrease as a function of experimental conditions and to make comparisons of the analysis procedures more 
meaningful with the post-hoc ANOVA serving as a control group. 
Computer Simulation Svstem 

The computer simulation system initialized by Wu and McLean (1993, November) and used by Wu 
(1994) and Wu and McLean (1994b) was modified for this study. This computer simulation system has been 
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demonstrated to be capable of generating dau that meet predetermined specifications and carrying out accurate 
simulations; also, the computer programs can be modified easily for many other studies (Wu & McLean, 
1994a). For this study, paired daU were generated from two linearly correlated normal populations. Data 
generated in this nature will meet the assumptions of ANOVA and ANCOVA, but will not completely satisfy 
the assumptions of block designs. Robustness of block designs under the circumstances has been illustrated 
analytically by Feldt (1958) and empirically by Maxwell and Delaney (1984). 

The computer programs used by Wu (1994) and Wu and McLean (1994b) were used for the post-hoc 
approach in this study. The specific computer codes and a detailed description of the simulation procedures can 
be found in Wu. The same seed numbers used by the two studies were used in this study. The results 
demonstrated Wu*s statement that experiments are replicable using the same seeds. The computer programs for 
the a priori approach are slightly different from the post-hoc approach and are listed in Appendix B. The same 
seeds used for the post-hoc approach were used for the a priori approach in order to compare the two 
approaches based on analyzing the same sets of data. 

Results 

The resulting power values under each experimental condition are listed in Appendix C. Each power is 
based on 3,000 analyses with a preset at .05. 
Optimal Number of Blocks 

Results show that the optimal nimiber of blocks to achieve maximum power increases as the 
correlation, the number of treatments, and the number of subjects per treatment increase. The optimal number 
of blocks for the a priori approach is essentially the same as that for the post-hoc approach. As adjacent 
numbers of blocks often yield very close power values, the optimal number of blocks has no clear-cut boundary. 
In fact, the power values are almost the same as the number of blocks approaches its optimal number. This is 
important for researchers because the optimal number of blocks may not be as crucial as it has been regarded, 
although theoretically there exists an optimal number of blocks. The results of this study support the 
recommendation by Wu and McLean (1994b) that researchers may select from a wide range of numbers of 
blocks if they avoid using small numbers of blocks when the correlation, the number of treatments, and the 
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number of subjects per treatment are large, and vice versa. The optimal numbers of blocks are listed in Table 
1. The purpose of this table is to show the trend that the optimal mmiber of blocks increases as the correlation, 
the number of treatments, and the number of subjects per treatment increase, rather than provide strict numbers 
of blocks for researchers to follow. 
Table 1 



The optimal number of blocks to achieve statistical j)ower 



Correlation 
Coefficient* 


Number 
of 

Treatments 


Number of Subjects per Treatment 


8 


40 


72 




2 


2 


10 


18 




3 


4 


10 


24 


.28 


4 


4 


20 


24 




5 


4 


20 


24 




2 


4 


10 


24 


.56 


3 


4 


20 


36 




4 


8 


20 


36 




5 


8 


20 


36 




2 


4 


20 


36 


.84 


3 


8 


20 


36 


4 


8 


40 


72 




5 


8 


40 


72 



'''Between concomitant and dependent variables. 

Post-hoc ANOVA (Completely Randomized ANOVA) as the Control Group 



When the correlation coefficient is zero, both a priori and post-hoc ANOVAs are as powerful as or 
more powerful than blocking and ANCOVA. They are more powerful when the number of subjects per 
treatment (n) and the number of treatments (T), especially n, are small. This is plausible because blocking and 
ANCOVA achieve no advantage over a completely randomized ANOVA when the correlation is zero and using 
blocking or ANCOVA loses degrees of freedom for error. Thus, for block designs, power is diminished when 
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a larger number of blocks is used. The loss of degrees of freedom has little impact when the sample size is 
large, but causes significantly more power loss as the sample size becomes small. 

The power of post*hoc ANOVA (completely randomized ANOVA) is controlled at .50 under all 
experimental conditions. The power of a priori ANOVA is also controlled at .50 when the correlation is zero. 
This is also plausible because a priori ANOVA is no different from the completely randomized ANOVA when 
the correlation is zero. But the power of a priori ANOVA drops as p and T increase. For example, a priori 
ANOVA loses .27 power with T = 5, n=72, and p = .84. The magnitudes of the power loss xmder each 
experimental condition are listed in Table 2. Loss of less than .02 are omitted for clarity. 
Table 2 



Power difference between a priori and post-hoc ANOVA 



Number of 
Subjects per 
Treatment 


Correlation 
Coefficient* 


Number of Treatments 


2 


3 


4 


5 


8 


.28 


t 


t 


t 


-.03 


.56 


t 


-.04 


-.07 


-.09 


.84 


t 


-.11 


-.21 


-.24 


40 


.28 


t 


t 


t 


-.03 


.56 


t 


-.03 


-.06 


-.10 


.84 


t 


-.12 


-.21 


-.26 


72 


.28 


t 


t 


t 


-.02 


.56 


t 


-.04 


-.07 


-.08 


.84 


t 


-.11 


-.21 


-.27 



* Between concomitant and dependent variables, 
t Denotes difference is less than .02. 

Power of Block Designs and ANCOVA 



The completely randomized ANOVA is the best choice and there is no need to block or covary when 
the correlation is zero. When the correlation is not zero, blocking and ANCOVA become more powerful than 
the completely randomized ANOVA as p, n, and T increase. Neither one procedure nor one approach is 
uniquely most powerful. ANCOVA is not generally more powerful than blocking and the a priori approach is 
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nmge from .10 to .21. When the correlation is high (o - 84^ ,h ■ 

nign (p _ .84), the ^creases are as high as .24 to .49 

Table 3 




^Denotes number of subjects per treatment. 
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Table 4 



Power increase using optimal blocking and ANCQVA for the post-hoc approach 



n* 




Number of Treatments 


2 


3 


4 


5 


Optimal 
Block 


ANCOVA 


Optimal 
Block 


ANCOVA 


Optimal 
Block 


ANCOVA 


Optimal 
Block 


ANCOVA 


Q 
O 




t 


t 


.02 


t 


.03 


t 


.04 


t 


.56 


.10 


.13 


.12 


.14 


.16 


.17 


.17 


.18 


.84 


.24 


.43 


.32 


.46 


.36 


.45 


.40 


.48 


40 


.28 


.03 


.03 


.03 


.03 


.05 


.04 


.05 


.03 


.56 


.13 


.16 


.16 


.17 


.19 


.17 


.21 


.18 


.84 


.31 


.46 


.38 


.47 


.41 


.46 


.45 


.48 


72 


.28 


.03 


.03 


.04 


.04 


.05 


.03 


.05 


.03 


.56 


.14 


.16 


.16 


.15 


.20 


.19 


.21 


.17 


.84 


.30 


.44 


.37 


.46 


.42 


.46 


.45 


.49 



* Denotes number of subjects per treatment. 

Denotes correlation coefficient between concomitant and dependent variables, 
t Denotes difference is less than .02. 



Table 5 



Power differences between optimal blocking and ANCOVA for the a priori approach 



n* 




Number of Treatments 


2 


3 


4 


5 


8 


.28 


t- 


t 


t 


t 


.56 


.04 


.04 


.04 


.02 


.84 


.09 


.04 


.03 


.02 


40 


.28 










.56 










.84 










72 


.28 










.56 










.84 











* Denotes number of subjects per treatment. 

♦* Denotes correlation coefficient between concomitant and dependent variables, 
t Denotes difference is less than .02. 
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Comparing Blocking and ANCQVA 

The power differences between optimal blocking and ANCOVA for both approaches are listed in 
Tables S and 6. 
Table 6 



Power differences between optimal blocking and ANCOVA for the post-hoc approach 







Number of Treatments 


n* 




2 


3 


4 


5 




.28 


t 


t 


4. 


-.02 


8 


.56 


.03 


t 


4. 
1 


t 




.84 


.19 


.14 


.10 


.08 




.28 


t 


t 


J. 

r 


-.02 


40 


.56 


.03 


t 


t 


-.03 




.84 


.14 


.09 


.05 


.03 




.28 


t 


t 


t 


-.02 


72 


.56 


t 


t 


t 


-.04 




.84 


.15 


.09 


.04 


.04 



* Denotes number of subjects per treatment. 

Denotes correlation coefficient between concomitant and dependent variables, 
t Denotes difference is less than .02. 



For the a priori approach, ANCOVA is more powerful than the optimal blocking procedure when the 
number of subjects per treatment is small and the correlation is moderate or high. For the post-hoc approach, 
ANCOVA is more powerful when the correlation is high while the optimal blocking procedure is slightly more 
powerful when the correlation is low or moderate and the number of treatments are large. These findings are 
different from those based on Apparent Imprecision that suggest ANCOVA is consistently better than blocking 
as the correlation mcreases (Feldt, 1958). Rather, the results support Maxwell and Delaney's (1984) statement 
that "^the recommendation of most experimental design texts to consider the correlation between the dependent 
and concomitant variables in choosing the best technique for utilizing a concomitant variable is incorrect" (p. 
136). 
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Comparing A Priori and Post-hoc Approaches 

Overall, the a priori approach yields little advantage over the post-hoc approach. The power means of 
the a priori and post-hoc approaches of ail the analysis procedures over all the experimental conditions except 
those with zero correlation are listed in Table 7. Tables 8 and 9 show the power differences between a priori 
and post-hoc approaches for optimal blocking and ANCOVA. 
Table 7 

Mean powers of analysis procedures for a priori and post-hoc approaches 



Design 


Approach 


a pnon 


post hoc 


ANOVA 






2 bloclcs 






3 blocks 


,0/7 


.00 J 


4 blocks 


.689 


.671 


S blocks 


.705 


.684 


6 blocks 


.708 


.690 


8 blocks 


.703 


.680 


9 blocks 


.715 


.696 


10 blocks 


.717 


.695 


12 blocks 


.717 


.698 


18 blocks 


.719 


.700 


20 blocks 


.721 


.699 


24 blocks 


.720 


.701 


36 blocks 


.721 


.702 


40 blocks 


.719 


.696 


72 blocks 


.720 


.700 


ANCOVA 


.723 


.717 
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Table 8 



Power differences between a priori and post-hoc approaches for optimal blocking 



Number of 
Subjects per 
Treatment 


Correlation 
Coefficient* 


Number of Treatments 




3 


A 

4 


5 


g 


.28 


t 


t 


t 


-.03 




.56 


.03 


t 


-.03 


-.02 




.84 


.13 


.12 


.07 


.05 


40 


.28 


t 


t 


t 


-.02 




.56 


.04 


t 


-.02 


-.04 




.84 


.14 


.08 


.05 


.03 


72 


.28 


t 


t 


t 


-.02 




.56 


.02 


t 


-.04 


-.03 




.84 


.14 


.09 


.05 


.04 



Between concomitant and dependent variables, 
t Denotes difference is less than .02. 



Table 9 



Power differences between a priori and post-hoc approaches for ANCQVA 



Number of 
Subjects per 
Treatment 


Correlation 
Coefficient* 


Number of Treatments 


2 


3 


4 


5 


8 


.28 


.03 


t 


t 


t 


.56 


.04 


.02 


t 


t 


.84 


.02 


t 


t 


t 


40 


.28 


t 


t 


t 


t 


.56 


t 


t 


t 


t 


.84 


t 


t 


t 


t 


72 


.28 


t 


t 


t 


t 


.56 


t 


t 


-.03 


t 


.84 


t 


t 


t 


t 



Between concomitant and dependent variables, 
t Denotes difference is less than .02. 



A priori blocking is more powerful than post-hoc blocking when the correlation is high. Post-hoc 
blocking is slightly more powerful than a priori blocking when the correlation is low or moderate and the 
number of treatments is large. A priori ANCOVA is more powerful than post-hoc ANCOVA when the number 
of subjects per treatment and the number of treatments are small. These results do not support Mv^well and 
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Delaney*s (1984) conclusion that the a priori approach is generally more powerful than the post-hoc approach. 
However, this study does support their findings for similar experimental conditions. But, Maxwell and Delaney 
used much narrower experimental conditions. Specifically, the power values in the upper-left three cells (T=2, 
n-8. and p-.28, 56, and 84) of Tables 8 and 9 actually support the results reported by Maxwell and Delaney. 
The pattern of the magnitudes of power differences is analogous to that of the Maxwell and Delaney study, 
where the magnitudes of differences are generally small except the one between a priori and post-hoc blocking 
when the correlation is high and the number of subjects per treatment and the number of treatments are small. 

Discussion and Recommendations 
No one procedure or single approach is uniquely more powerful. Although the most powerful 
technique to employ a concomitant variable varies depending on the experimental conditions, most of the 
magnitudes of the power differences are not large enough to be practically significant. It is recommended that 
researchers utilize the tables provided in this study to help select the best technique when employing a 
concomitant variable. 

The problems concerning utilizing a concomitant variable become complicated when considering a 
variety of experimental conditions, methods of assignment, and assumptions of the analysis procedures. Despite 
these complications, the results of this study show t^at choices in research practice may have little impact 
because many of the power differences are small. Based on practical significance, this study suggests the 
simplest rule to follow is use regular ANCQVA (post-hoc ANCQVA) if its assumptions can be met . The 
rationale for preference of blocking over ANCOVA reported by earlier experimental design texts, such as ease 
of calculation and ability to test simple effects, seems to have faded away recently. With modem computer 
statistical packages, ANCOVA becomes at least as easy to compute as block designs. Using regular ANCOVA, 
researchers need not consider questions such as whether the concomitant variable is available before the 
experiment, how to assign subjects, what is the magnitude of the correlation, and how many blocks should be 
used, and still gain power though not necessarily achieve maximum power. The power differences between 
post-hoc .\NCOVA and the optimal procedure are of little practical significance under most experimental 
conditions, and do not exceed .04 even in the most extreme cases. 

ERIC 



A Priori Versus Post-Hoc 
13 

When the correlation is zero, the waste of degrees of freedom due to blocking and ANCOVA may 
result in the reduction of power. Wasting degrees of freedom has httle influence on power when T and n are 
large but has an effect when T and n are small. For example, the power drops from .50 to .43 when using 
post-hoc 8 block analysis procedure for p = .00, T = 2 and n=8. Because this study uses a minimum n of 8, the 
loss of one degree of freedom using ANCOVA, especially a priori ANCOVA, when the correlation is zero, 
seems to have little effect on the loss of power. However, one should be cautious that the loss will increase as 
n becomes smaller. Much of the criticism of the post-hoc approach is based on the ease with which researchers 
can block or covary in a post-hoc maimer, Myers (1979) pointed out the danger of abusing post-hoc block 
designs by demonstrating that reordering scores within each treatment does not change the treatment means but 
generally reduces the error variance, resulting in significant Fs which "merely reflect the reduction in error 
variance due to blocking rather than any variability due to treatments" (p. 155). However, Myers did not 
consider the loss of degrees of freedom with block designs. Wasting degrees of freedom on some nonsense 
concomitant variable would simply decrease power. Nevertheless, the caution urged by Myers should be 
considered. It is often too easy to peek at the data, play with several concomitant variables, or try several 
analysis procedures to achieve significant results. However, these should be considered ethical problems rather 
than problems of the post-hoc approach per se. Researchers should neither block nor covary imless they can 
justify the concomitant variable before the analysis. If researchers would always consider practical as well as 
statistical significance, these problems could be avoided as none of these analysis techniques affect effect sizes. 

One of the most interesting findings of this study is the problem with a priori ANOVA. Maxwell and 
Delaney (1984) questioned this method and detected minor Type I error rate problems with it. But the Type II 
error rate problem with a priori ANOVA was not detected in their study. This is because their study was 
limited to two treatments. Future research could investigate the Type I error rate using broader experimental 
conditions. A follow-up Monte Carlo study comparing a priori and post-hoc ANOVA by examining the sample 
distributions of the variances showed that the power loss of a prior ANOVA was due to a decrease of treatment 
variance and an increase of error variance while stratified instead of randomized assignment is used. The Type 
II error rate problem with a priori ANOVA may provide the best example of how power can be different from 
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Apparent Imprecision; the precision of a priori ANOVA is higher than the completely randomized ANOVA but 
results in lower power. Thi? may also explain why the a priori approach is not generally more powerful than 
the post-hoc approach. A priori does achieve more homogeneous blocks and ensures more equal covariates 
across treatments. But, the advantages are reduced by the loss of power due to stratified rather than random 
assignment. Stratified assignment is still a common practice. It is believed to guarantee fairness of treatments 
and avoid preexisting differences. Some suggest that stratified assignment reduces error and increases power. 
Based on the results of this study, if stratified assignment is used, the concomitant variable should not be 
ignored in the analysis. Since stratified assignment loses power due to non-random sampling but gains power 
because of providing more homogeneous blocks for analysis, future research could investigate whether there is 
an optimal combination of the number of blocks used in assignment and the number of blocks used in analysis. 

Wu and McLean (1994b) suggested four reasons that Maxwell and Deianey's (1984) results differed 
from theirs: (1) limited experimental conditions, (2) not including the optimal number of blocks> (3) including 
the interaction in the effects model, and (4) inaccuracy of the computer simulation. The results of this study 
show that not including the optimal number of blocks causes only minor power loss, and the inaccuracy of this 
computer simulation and that of the Maxwell and Delaney study is imlikely because resiilts of the two studies 
support each other for similar experimental conditions. Among the four factors^ the restriction of experimental 
conditions and including the interaction in the effects model should contribute the most to the different findings. 
Conclusions based on restricted conditions may limit generalization. As to the interaction factor* the two studies 
complement each other's findings as sonche researchers suggest pooling the interaction variance with the error 
variance when the interaction is non-significant while other researchers do not. Note that Maxwell and Delaney 
did not specify that the interaction was included in the effects model. Our conclusion is based on the statement 
•perform a two-way analysis of variance (ANOVA) utilizing levels of the concomitant variable as a factor in the 
design" (p. 138). 

A randomized complete block design is defined as a block design in which each block within each 
treatment has only one observation. Lindquist (1953) used the term, treatments-by-levcls design^ which consists 
of more than one subject in a cell, to differentiate it from the randomized complete block design. The 
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treatments-by-levels design is also called the treatments-by-blocks design (Kennedy Sc Bush 1985). V/hile the 
randomized complete block design usually uses an additive model because there is only one ohserv^ation per cell, 
the treatments-by-blocks design can either use an additive or nonadditive model by excluding or including the 
interaction term in the effects model. The additive model is used in this study because the interaction does not 
exist in the population. Which model to be used should be based on researchers* subject matter knowledge and 
should be justified before the experiment. For example, suppose the concomitant variable is an IQ score, the 
dependent variable is a Scholastic Achievement Test (SAT) score, and the treatments are some teaching 
methods. If researchers can justify that the correlation between the IQ score and the SAT score should not be 
influenced by the teaching methods, the additive model should be used. When an additive model is used, the 
concomitant variable is treated as a nuisance variable and the variance accounted for by the concomitant variable 
is nuisance variance, which is out of the researcher^s interest and is to be extracted to reduce error and increase 
power. But, if the dependent variable is a computer attitude measure and the researcher cannot justify that high 
IQ students usually have better attitudes toward computers, disregarding the teaching methods used, the 
nonadditive model should be used. Under these circumstances, the concomitant variable is no longer a nuisance 
variable; rather, it is a factor of interest because the researcher would want to test if a teaching method is better 
for low IQ than high IQ students. In this case, the block design in form, in analysis, and in interpretation is 
undistinguishable from a factorial design. The difference is that in a factorial design subjects are assigned to 
each combination (cell) of factors, while in block designs subjects in each block level are assigned to treatments 
and the block factor is usiudly intrinsic in the subjects themselves. 

The question of should nonadditive block designs be categorized as block or factorial designs adds some 
difficulty to the nomenclature of experimental designs. The alternative uses of terms such as blocking, factorial, 
and stratification by researchers certainly add some confusion. Which model to use and whether to adhere to 
the original model or revise it during the analysis process should be justified in advance. In many instances, the 
researcher includes the interaction for convenience. If the interaction is non-significant, some researchers pool 
the interaction variance with the error variance in order to increase power. The issue of pooling and non- 
pooling is still disputed. If the interaction does not exist in the population, pooling the interaction variance with 
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the error variance should provide a better estimate of the error term and increase power due to an increased 
number of degrees of freedom for the error term. 

Using nonadditive model suggests another question: Should the block levels formed by ranking be 
treated as random or fixed? If random, the interaction should be used as the error term to test the treatment 
effect (see Kirk, 1982, p. 240-241); if fixed, the within cell variance should be used as the error term (see 
Feidt, 1958; Maxwell & Delaney, 1984). Levels based on the rank of sample subjects seem to be more fixed, 
though not completely fixed, than random because ranking is deterministic instead of random. Calculating 
expected mean squares seems to be the most appropriate way to obtain the error terms, which is beyond the 
scope of this discussion. However, future Monte Girio studies could block the population to obtain completely 
fixed block levels. Boundaries for block levels can be set based on two principles: equal proportion or equal 
interval (Feldt, 1958). In research practice, blocking a population is aoc feasible in most cases. An alternative 
method is to randomly select subjects, then fit them into corresponding levels. This would most likely resxilt in 
unequal numbers of subjects in the blocks. To obtain an equal number of subjects in each block, researchers 
could kee^y on randomly selecting subjects \mtii the required number of suojects fit in each block level and 
discard those exceeding the required number of subjects. 
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Appendix A 

Examining Apparent Imprecision may provide an insight of how it can be similar to or different from 
power. Apparent Imprecision is defined as the product of True Imprecision and an adjustment factor based on 
the degrees of freedom for error: 

• a\e var ^t'^^ 
I = X » 

^ min var df^-^l 
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where, ave var is the average variance of the treatment mean difference from sample to sample; and min var is 
the theoretical minimum variance of the treatment mean difference. According to Feldt (1958), the minimum 
variance is the variance of the dependent variable at a fixed value of the covariate given the assumption of 
homoscedasticity. For block designs, Apparent Imprecision (Algo) is computed with the following formula: 
^ 2 — 2 — 2 

_ « Ox W '^x A 

n 

where Y represents the dependent variable; X» the concomitant variable; p, the correlation coefficient between 
X and Y; n, the number of subjects per treatment; o^, the average variance of X over ail blocks; and / , the 
degrees of freedom for error in Y. For ANCOVA, Apparent Imprecision is computed using the following 
formula: 

Ai - , A*' _ :^ 



n 

where stands for the degrees of freedom for error in X. 

For block designs, the average variance of the covariate over all blocks decreases and the True Imprecision 
approaches 1.00 as the number of blocks increases. Theoretically, if an infinite number of blocks could be 
used, the values of the concomitant variable would be the same in each block, and True Imprecision would be 
exactly 1.00. This does not mean that employing a larger number of blocks always decreases Apparent 
Imprecision, because as larger numbers of blocks are used, larger degrees of freedom for error are lost, and, 
based on the adjustment factor. Apparent Imprecision increases. Therefore, there is an optimal number of 
blocks that minimizes True Imprecision, yet, on the other hand, minimizes the increase of Apparent Imprecision 
due to the loss of degrees of freedom for error. This phenomenon of Apparent Imprecision is analogous to that 
of power. For the same reason, there is an optimal number of blocks such that the higher the degree of the 
correlation between the concomitant and dependent variables, the more homogeneous the values of the 
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dependent variable are in each block, the more variance that is extracted from the error term, the higher the 
power. At the same time, the power is decreased due to the loss of degrees of freedom for error. To optimize 
power, one must find a balance between these two forces. Apparent Imprecision is similar to power in this 
regard. 

Nevertheless, Apparent Imprecision could suggest different results from power. For block designs, the 
average variance and the minimum variance decrease as the correlation increases. But, the average variance 
would never decrease as much as the minimum variance unless an infinite number of blocks were used. 
Therefore, the Apparent Imprecision of a block design usually increases as the correlation increases. For 
ANCOVA, the correlation terms in the numerator and denominator are canceled out because the average 
variance is a function of the minimum variance. Notice that the minimum variance is the ideal variance based 
on the covariance model. Therefore, the Apparent Imprecision of ANCOVA is the same for all values of the 
correlation. This is basically why block designs are found to consistently become less precise than ANCOVA 
as the correlation increases and why the correlation has been regarded as the critical factor in choosing block 
designs or ANCOVA. The correlation being negative in a block design and irrelevant in ANCOVA based on 
Apparent Imprecision is different from what most texts and this study have found about the positive effect of 
higher correlation in reducing error and increasing power. 

A simple rule to follow when evaluating a criterion variable is to determine if it provides a direct measure 
of the variable of interest. For example, if a new brand of bulbs is to be evaluated, it is better to check how 
long the bulbs last rather than to analyze the precision of the components of the bulbs. The precision of the 
components of the bulbs would be a good criterion if it could determine a useful property; for example, the 
more precise the element is, the longer the bulbs last^ the less power the bulbs consume, or the less eye strain 
the bulbs cause. A theoretical framework merits less if the degree it can be related to the physical property of 
interest is low. For example, the theory of the imagined number /-T would not have been valuable if it coxild 
not be used to predict the behavior of electronic circuits. Based on the rule, the Type I error rate and statistical 
power should be considered a good criterion in evaluating a research design. 

Maxwell and Delaney (1984) also illustrated how Apparent Imprecision might be different from powen 
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Suppose an experimenter plans to conduct a two-group comparison of means using an alpha level of 
0,05. If the population difference in means is .5 standard deviation units, and 150 subjects are 
randomly and independently assigned to groups, the power for an independent groups t test is 0.99. 
Suppose that a concomitant variable were available that correlated .6 with the dependent variable. The 
power of an ANCOVA would still be 0.99 (or, actually, 1.00 if rounded to two decimal places). From 
the standpoint of power, the ANCOVA offers no gain over the t test. On the other hand, it can be 
shown that the apparent imprecision of the t test here is 1.573, whereas for ANCOVA the apparent 
imprecision is 1.010, demonstrating that the estimated magnitude of the treatment effect is much more 
precise when ANCOVA is used rather thm the t test, (p. 137) 
One might interpret, facially, the above demonstration as a benefit of using Apparent Imprecision as the 
criterion variable. However, it should be noticed that the powers of the t test and the ANCOVA have both 
reached the ceiling point because of the large sample size that was used,. Based on the rule, this illustration, 
indeedt offers an example of power as a favorable criterion. If one can achieve a .99 power with a t test, what 
is the advantage of spending money on collecting concomitant daU? For exan:q)le, administering a pretest or IQ 
test, to gain an impractical .001 power. Eventually, almost all analysis will become statistically significant if a 
large enough size is used. What is the use of a new teaching method that claims to increase students* SAT 
scores by 1 point? Practical significance would also need to be considered when evaluating the results of an 
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Executable File 
/• */ 
ADDRESS COHHAMD 
"ERASE RVALUE DATA A»« 
NUMERIC DIGITS 10 
TIME = 1 

DO WHILE TIME < 1001 

SEED « 2132560 * (TIME -1) * 21474^3 

"EXECIO 1 DISKU** NEUSEED DATA A "(STRING" SEED 

"EXEC SAS T57284" 

"ERASE NEUSEED DATA A«« 

TIME^TIME+I 

END 

"EXEC SAS T57284P« 



DATA BIVNORM; 



CMS FILEDEF SASLIST DISK T57284 LISTING A; 



DATA BIVNORM; 
SET BIVNORM; 
B72=CEIL( N /5); 

B2»CEIL(B72736);B3aCEIL(B72/24); 
B4«CEIL(B72/18);B6«CEIL(B72/12); 
Ba«CEIL(B72/9);B9xCEIL(B72/8); 
Bl2«CEIL(B72/6);B18«CEIL(B7:>/4); 
824»CEI L(B72/3 ) ; B36-CE I L(B72/2 ) ; 



PROC SORT; 
BY X; 



DO I»1 TO 360; 
X»RANNOR(SEED); 

Y«.84*X'»-S0RT ( 1 - . 84**2 )*RANNOR ( SEED ) ; 
OUTPUT; 



END; 



INFILE INDATA; 
INPUT SEED; 



First SAS Program (TS7284 SAS A) 

CMS FILEDEF INDATA DISK NEUSEED DATA A; 

CMS FILEDEF PVALUE DISK PVALUE DATA A (LRECL 306 

BLKSIZE 306 RECFM FBS; 
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PROC SORT; 

BY 872 I; 
DATA BIVNORM (DROPsSEED I); 

SET BIVNORM; 

GR0UP:#400( N ,5); IF GROUP^'O THEN GROUP^S; 

IF GR0UP=2''thEM Y-0.095UY; 

IF GR0UP=3 THEM Y»0.1903+Y; 

IF GR0UP=4 THEM Ya0.2854+Y; 

IF GR0UP=5 THEN Ya0.3805+Y; 
PROC PRINT; 
PROC SORT; 

BY GROUP; 
PROC CORR DATAsBIVNORH; 

VAR X Y; 

BY GROUP; 
PROC ANOVA; 

CLASS GROUP; 

HOOEL Y^GROUP; 
PROC ANOVA; 

CLASS GROUP B2; 

HOOEL Y^GROUP B2; 
PROC ANOVA; 

CLASS GROUP B3; 

HOOEL Y^GROUP B3; 
PROC ANOVA; 

CLASS GROUP 84; 

HOOEL Y~GROUP B4; 
PROC ANOVA; 

CLASS GROUP 86; 

HOOEL Y:sGROUP B6; 
PROC ANOVA; 

CUSS GROUP B8; 

HOOEL Y^GROUP Bd; 
PROC ANOVA; 

CLASS GROUP 89; 

HOOEL Y::GROUP 89; 
PROC ANOVA; 

CLASS GROUP 812; 

HOOEL Y3GR0UP 812; 
PROC ANOVA; 

CUSS GROUP 818; 

HOOEL YsGROUP B18; 
PROC ANOVA; 

CLASS GROUP 824; 

HOOEL YsGROUP 824; 
PROC ANOVA; 

CLASS GROUP B36; 

HOOEL Y::GROUP 836; 
PROC ANOVA; 

CUSS GROUP 872; 

HOOEL Y»GROUP 872; 
PROC GLH; 

CUSS GROUP; 

HOOEL Y'GROUP X/SS3; 
DATA; 

INFILE SASLIST; 

INPUT U0RD1 $ U0R02 $ 3; 

FILE PVALUE HOO; 

IF W0RD1 = 'X' AND W0RD2 »'72' THEN DO; 
INPUT MEAN STDDEV; 
PUT MEAN 6.4 STDDEV 6.4 3; 
INPUT Y $ N HEAM STDDEV; 
PUT MEAN 6.4 STDDEV 6.4 9; 
END; 

ELSE IF UORDls"X** AND W0RD2 * M. 00000' THEN 
DO; 

INPUT CORR; 
PUT CORR 6.4 a; 
END; 



21 



ELSE IF WORD 1 -"GROUP" AND U0RD2 * '4' THEN DO; 
INPUT SS HS F PR; 
PUT PR 6.4 9; 

INPUT 8L0OC $ DF SS NS F PR; 
PUT PR 6.4 d; 
END; V 

Second SAS Program (T57284P SAS A) 
CMS FILEDEF INDATA DISK PVALUE DATA A; 
DATA PVALUE; 
INFILE INDATA; 

INPUT (GIXMEAN GlXSO G1YMEAN GlYSD GICORR 
G2XMEAN G2XSD G2YMEAN Q2YSD G2C0RR 
G3XMEAN G3XS0 G3YMEAN G3YSD G3C0RR 
G4XMEAN G4XS0 G4YMEAN G4YSD G4C0RR 
GSXMEAN G5XS0 G5YMEAN GSYSO GSCORR 
GR0UP18 8L0OC18 GR0UP2B BLOCXas CR0UP38 
8L0CK3B GR0UP48 BL0aC48 GR0UP6B 8L0C)(6B 
GR0UP88 8L0CK88 QR0UP9B 8L0a9B GR0UP12B 
8L0C)C12B GR0UP18 GR0UP18B BLCOCISB QROUP24B 
8L0C)C248 GR0UP368 BL0DC36B GR0UP72B 
8L0OC72B GROUPANC BLOCKANC) (51* 6.4); 

GIBSG^O; 

BiBSGsO; 

G2BSGsO; 

B2BSG=:0; 

G38SG=0; 

B38SG=0; 

G48SG=0; 

B48SGsO; 

G66SG=0; 

B6BSG=0; 

G88SG»0; 

BSBSGsO; 

G9BSG>0; 

B98SG=>0; 

Gl2BSGsO; 

B12BSG«0; 

GISBSG^O; 

B188SG::0; 

G24BSG>0; 

B24BSG»0; 

G36BSG»0; 

B36BSGsO; 

G72BSGxO; 

B72BSGsO; 

GANCSG-O; 

BANCSG=0; 

T0TAL«1; 

IF GR0UP18 <s 0.05 THEN GIBSG^I; 
IF BL0CK1B <" 0.05 THEN B1BSG«1; 
IF GR0UP28 <" 0.05 THEN 62BSG"1; 
IF BL0CK2B <" 0.05 THEN B28SGs1; 
IF GR0UP3B <« 0.05 THEN G3BSG«1; 
IF BL0CK3B <« 0.05 THEN B38SG«1; 
IF GR0UP4B <* 0.05 THEN G48SG«1; 
IF BL0CK48 <> 0.05 THEN a4BSG>1; 
IF GR0UP68 <« 0.05 THEN a6BSG«1; 
IF BL0CK68 <» 0.05 THEN B6BS&«1; 
IF GR0UP88 <- 0.05 THEN G8BSG«1; 
IF BL0CK88 <> 0.05 THEN B86S6«1; 
IF GR0UP98 <" 0.05 THEN G9BS6«1; 
IF BL0CK9B <" 0.05 THEN B98SG»1; 
IF GR0UP128 <" 0.05 THEN G12BSG«1; 
IF BL0CK128 <" 0.05 THEM B128S01; 
IF GR0UP188 <" 0.05 THEN G18BS01; 
IF BL0CK18B <f 0.05 THEN BldBSG^I; 
IF GROUP24B <« 0.Q5 THEN G248SG-1; 
IF BL0CK24B <« 0.05 THEN B24«S&>1; 
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IF GR0UP36B 0.05 THEM G36BSGs1; 

IF BL0C)G6B <« 0.05 THEM 8368SGa1; 

IF GR0UP72B <= 0.05 THEM G72SSGs1; 

IF BL0CIC72B <« 0.05 THEM B72BSGa1; 

IF GROUPANC <= 0.05 THEM GAMCSG-1 ; 

IF BLOCKAMC 0.05 THEM BAMCSG«1; 
PROC FREQ; 

TABLE G1BSG 3AMCSG; 
PROC SUMMARY DATA=:PVALUE; 

VAR G1XMEAM — BAMCSG; 

OUTPUT OUT X DESCRIPT; 
PROC PRIMT DATA=OESCRIPT; 
PROC UMIVARIATE DATA=PVALUE PLOT MORKAL; 

VAR GIXMEAN BLOCKAMC; 



Appendix C 

Power Table 





ANO 


B02 


B03 


B04 


B05 


B06 


B08 


B09 


BIO 


B12 


B18 


B20 


B24 


B36 


B40 


B72 


COV 


T2 


n08 


COO 


A 


.505 


.498 




.489 






.449 




















.498 








P 


.497 


.491 




.W 






.430 




















.457 






C28 


A 


.506 


.519 




.513 






.472 




















.527 








P 


.505 


.510 




.511 






.470 




















.501 






C56 


A 


.500 


.592 




.616 






.584 




















.658 








P 


.490 


.565 




.589 






.554 




















.623 






C84 


A 


.484 


.773 




.872 






.870 




















.958 








P 


.501 


.680 




.740 






.730 




















.934 




n40 


COO 


A 


.502 


.498 




.501 


.501 




.500 




.500 






.498 






.483 




.501 








P 


.503 


.503 




.503 






.502 




















.506 






C28 


A 


.508 


.526 




.535 


.537 




.533 




.536 






.535 






.525 




.539 








P 


.501 


.521 




.529 


.529 




.532 




.532 






.527 






.521 




.533 






C5c 


A 


.499 


.603 




.648 


.655 




.660 




.663 






.661 






.652 




.671 








P 


.499 


.563 




.613 


.614 




.622 




.623 






.624 






.621 




.657 






C84 


A 


.498 


.820 




.908 


.919 




.939 




.943 






.949 






.948 




.953 








P 


.498 


.693 




.769 


.779 




.797 




.802 






.812 






.805 




.954 




n72 


COO 


A 


.502 


.503 


.502 


.503 




.502 


.503 


.500 




.501 


.500 




.500 


.500 




.493 


.503 








P 


.513 


.511 




.511 






.509 




















.507 






C28 


A 


.505 


.521 


.526 


.530 




.532 


.533 


.535 




.535 


.538 




.537 


.536 




.539 


.531 








P 


.501 


.522 


.527 


.529 




.533 


.531 


.532 




.533 


.532 




.531 


.532 




.529 


.535 






C56 


A 


.495 


.598 


.622 


.634 




.643 


.649 


.649 




.653 


.656 




.660 


.660 




.657 


.660 








P 


.499 


.579 


.606 


.614 




.624 


.627 


.628 




.630 


.629 




.636 


.633 




.628 


.655 






C84 


A 


.496 


.819 


.884 


.910 




.930 


.939 


.940 




.943 


.948 




.947 


.948 




.947 


.950 








P 


.510 


.694 


.748 


.769 




.788 


.794 


.799 




.805 


.807 




.808 


.809 




.806 


.954 



continued) 



A Priori Versus Post-Hoc 



23 



T3 



1 


ANO 


oUc 




804 


BOS 


B06 


B08 


B09 


B10 


B12 


B18 


820 


824 


836 


840 


872 


cov 


n08 


COO 


A 








.491 






.471 




















.492 






P 


.508 


.508 




.495 






.481 




















.485 




C28 


A 








.506 






.495 




















.516 






P 


.493 


. J 14 




.516 






.501 




















.512 




C56 


A 


.463 


CO/ 

.584 




.621 






.619 




















.658 






P 


.498 


.591 




.617 






.607 




















.634 




C84 


A 


.376 


.762 




.888 






.924 




















.966 






P 


.490 


.720 




.797 






.809 




















.952 




COO 


A 


.499 


.499 




.498 


.500 




.497 




.498 






.498 






.498 




.500 






P 


.503 


.501 




.501 






.500 




















.498 




C28 


A 


.493 


.5c5 




.531 


.535 




.538 




.536 






.534 






.534 




.539 






P 


.508 


.526 




.533 


.535 




.537 




.537 






.539 






.537 




.540 




C56 


A 


.469 


.598 




.650 


.654 




.671 




.669 






.676 






.670 




.678 






P 


. 500 


.oOc 




.641 


.647 




.656 




.658 






.6(32 






.658 




.667 




C84 


A 


.378 


.800 




.913 


.927 




.943 




.949 






.954 






.956 




.965 






P 


-493 


.744 




.831 


.843 




.864 




.864 






.877 






.870 




.960 




COO 


A 


.4o6 


.486 


.487 


.487 




.488 


.485 


.486 




.487 


.488 




.484 


.482 




.485 


.486 






P 


.504 


.505 




.506 






.504 




















.506 




C28 


A 


.494 


CO/ 

.524 


.533 


.533 




.536 


.538 


.538 




era 

.538 


.538 




.538 


.536 




.537 


.544 






P 






. 


. jCj 




.5cf 




.5co 




.531 


.533 






.33i> 




.531 


.530 




C56 


A 


.466 


.589 


.622 


.636 




.650 


.654 


.656 




.658 


.659 




.663 


.663 




.661 


.666 






P 


.508 


.610 


.638 


.648 




.661 


.665 


.666 




.669 


.672 




.670 


.671 




.671 


.658 




C84 


A 


.395 


.815 


.902 


.929 




.945 


.952 


.953 




.957 


.961 




.961 


.964 




.964 


.964 






P 


.504 


.742 


.807 


.834 




.851 


.858 


.863 




.867 


.871 




.875 


.875 




.873 


.968 



(continued) 



ERIC 



2o 



A Priori Versus Post-Hoc 
24 





ANO 




B03 


B04 


B03 


B06 


B08 


809 


BIO 


B12 


B18 


B20 


B24 


B36 


B40 


B72 


cov 


n08 


COO 


A 














.484 




















.502 






? 








t Q*7 






.477 




















.485 




C28 


A 




.3 10 




.3 ly 






cm 

. 3 lU 




















.336 






? 




S?0 




S75 
. 3 






«;55 

. 3cc 




















CIO 

.310 






A 




. J r c 




A1 0 

.o 1 y 






A7!> 




















.ooy 






P 




. O 1 o 




AS1 

• 03 1 






• 03 / 




















AAA 
.000 




C84 


A 




• tJfm 




ROT 






07 S 

.yj3 




















QAA 

.yoo 






? 




. /04 




OCT 

.03J 






.063 




















.964 


n40 


COO 




.509 


.508 




.508 


.506 




.507 




.507 






.504 






.503 




.510 






P 


.505 


.507 




.506 






.504 




















.500 




C28 


A 


.479 


.516 




.524 


.525 




.528 




.526 






.529 






.529 




.532 






P 


/ Q/ 






. 3^0 


CTZ. 




.340 




.3 JO 






C/ 1 

. 341 






.333 




.532 




C56 


A 


/ 7Jl 


sm 




.o^y 


.o4o 




AQ A 
.030 




ACQ 

.o3y 






AAQ 
• 000 






•o6a 




.674 






P 


sn5 






.OOc 


.ooy 




.ory 




.Oc 1 






.000 






.003 




A70 

.ore 




no/ 


A 


. CT I 


. (Of 




055 

. ycc 


0/ n 




OS 7 

. y3 J 




OSA 

. y30 






OA 5 

. yoii 






OAA 




QAQ 

. yoy 






P 








.or 3 


ftftA 

.occ 




ons 




onn 
. yuo 






017 

. y 0 






01A 




OAA 

.yoo 




coo 


A 




sn7 


sni 


sn5 

. 3U4l 




/ oo 


sn5 

. 3Uc 


sni 

.3U 1 




snn 


sn5 
. 3Uc 




sn7 

. 3UJ 


sni 

.3U 1 




cn/ 


cn!> 
.3Uc 






P 




snn 




. 3Uo 






.3U0 




















. 3Uo 




Cco 


A 




.3 lU 


. 31 / 


.3cU 




. 3Cl 


CO/ 

.3£4 


.3C3 




.3c4 


.3co 




C5«; 

. 3c3 


C5A 
.3 CO 




CO/ 


coo 
.34:0 






P 












S70 


S70 
. 3 jy 


S^l 




SAH 
. 3*fU 


.3*f 1 




S^l 


S^7 




S^7 


SP7 




C56 


A 


.428 


.578 


.611 


.630 




.641 


.651 


.655 




.657 


.661 




.661 


.663 




.661 


.660 






P 


.498 


.626 


.662 


.677 




.686 


.693 


.695 




.695 


.698 




.699 


.701 




.699 


.692 




C84 


A 


.303 


.811 


.900 


.930 




.954 


.959 


.961 




.965 


.965 




.967 


.969 




.970 


.973 






P 


.508 


.788 


.349 


.877 




.901 


.912 


.915 




.920 


.923 




.923 


.925 




.924 


.969 



T4 



(continued) 



A Priori Versus Post-Hoc 
25 





ANQ 


B02 


B03 


B04 


B05 


B06 


Boa 


B09 


BIO 


B12 


818 


B20 


B24 


B36 


B40 


872 


cov 


T5 


n08 


COO 


A 


C 1 c 
.31 J 


.312 




.511 






.496 




















.509 


P 


Cno 

. jOo 


cnT 
.303 




.502 






.488 




















.486 


C28 


A 


.471 


C n"y 

.507 




.515 






.514 




















.522 


P 


.502 


.532 




;540 






.533 




















.518 


CS6 


A 


.421 


Co/ 

.304 




.646 






.658 




















.679 


P 


Cm 
.310 






.678 






.680 




















.689 


CB4 


A 




. /37 




.906 






,947 




















.971 


P 


.494 


. rf\ 




.875 






.893 




















.970 




COO 


A 


.304 


c n/ 
.3 04 




CnC 

.505 


.503 




.500 




.501 






.502 






.502 




.504 


P 


.509 


» 509 




C 4 4 
.511 






.513 




















.506 


C2a 


A 


.479 


C 4C 

.3l3 




.526 


.530 




.530 




.532 






.529 






.530 




.537 


P 


Cn/ 

.504 


.537 




.549 


.551 




.555 




.555 






.554 






.552 




.532 


C56 


A 


.413 


.582 




.641 


.652 




.666 




.668 






.678 






.678 




.680 


P 


.508 


.645 




.690 


.702 




.710 




.711 






.714 






.712 




.685 


ca4 


A 


.238 


.781 




.926 


.942 




.960 




.966 






.973 






.973 




.979 


P 


.495 


.814 




.901 


.913 




.931 




.934 






.940 






.940 




.973 




n72 


coo 


A 


.302 


.503 


Cni 

.502 


Cn4 
.501 




.502 


.500 


.501 




.500 


Cn7 

.503 




.501 


.502 




.501 


.502 


P 


.4yo 


.4yo 




.497 






/ nc 
.4V5 




















.500 


C28 


A 


.4/4 


. 3 lU 


Cl ? 
.31 1 


coo 




CO/ 

.524 


coz. 
.526 


COQ 




COQ 

.52o 


coo 
.529 




coo 
. 529 


COQ 




coz. 
.526 


CT4 
.501 


P 




. 3J)C 


. 3*» I 






. 3*»f 




. 




.3Ha 


. 3'K) 




. 3*>y 


■ JHt 




. 3h3 


50fl 

.5co 


C56 


A 


.420 


.583 


.627 


.645 




.666 


.671 


.673 




.676 


.679 




.681 


.683 




.681 


.685 


P 


.504 


.642 


.674 


.690 




.703 


.706 


.711 




.711 


.714 




.714 


.715 




.717 


.675 


CS4 


A 


.227 


.781 


.888 


.920 




.949 


.961 


.964 




.968 


.972 




.972 


.973 


> 


.974 


.976 


P 


.492 


.807 


.870 


.895 




.918 


.923 


.927 




.930 


.934 




.936 


.937 




.936 


.981 



Note . Tx represents a number of treatments of x. Nxx represents a nanber of subjects per treatment of xx. 

Cxx represents a correlation coefficient between the concomitant and dependent variables of .xx. ANQ 
represents ANOVA. Bxx represents a block design with xx blocks. COV represents ANCOVA. A 
represents the a priori approach. P represents the post-hoc approach. 
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